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Overview 


*  Situation:  Human  Computer  Interface  (HCI)  critical  factor 
in  efficiency  and  effectiveness  of  modern  Command  and 
Control  (C2) 


•  Complication:  Cognitive  Systems  Engineering  (CSE)  lacks 
HCI  design  methodology 

« Implication:  Expensive  custom  designs,  and  uncertain 
outcomes,  marginalizes  CSE  contributions  in  Systems 
Engineering  projects 

*  Solution:  Reusable  HCI  design  patterns  for  C2  cognitive 
work 


•  Benefit:  CSE  delivers  reusable  HCI  software,  meeting 
affordability  goals  and  assurance  of  HCI  performance 
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HCI  Design  Patterns 

Assisting  Common  IT  Interactions 


History  of  the  Science  foundation 

*  Origin  in  building  architecture 
(Alexander,  1977) 


Website  /  Navigation: 
“Double-Tab” 


1  Main  )  0*ak!cpt  |  |  I  Hot  D«a!sl 


•  Software  patterns  to  share 
coding  approaches 

•  HCI  Design  Patterns 

-  “...a  structured  textual  or  graphical 
description  of  a  proven  solution  to 
a  recurring  desig  n  problem” 
(Borchers,  2001) 

-  Several  online  pattern  libraries 
(www.welie.com) 

-  Framed  around  common 
interactions  with  a  class  of  IT 
(web,  desktop  app,  mobile  device) 


Desktop  App  /  File  Selection: 
“Preview” 


Mobile  Phone:  “Selection” 


■— 0oO9l*”— 
Zoek  optiet 


Tolale  Veb  nunaer 

..  Wobifrl#  V»b 

W^lient  Back 


OWflbuHon  subject  to  HwWationa  on  t<la  pag> 


SPAWM 
Sytl0m*  C*rt«r 
SsnOt^gc 


HCI  Design  Patterns 

Assisting  Complex  Cognitive  Work 


Work-Aiding  Approach 

•  HCI  design  patterns  assisting  skilled 
task  performance  in  operational 
domains 

•  Frame  HCI  design  patterns  around 
interactions  with  a  “work  field” 

-  Work  Function  Types  (Eggleston,  2002) 

•  Decisions  &  typical  problem  cases 

•  Collaboration 

•  Product  development 

•  Work  management 

-  Context:  Factors  &  Constraints 

-  Work  Field  construct 

•  Ecological  Psyrchology 

(e.g.,  James  Gibson,  John  Flach) 

•  Cognitive  ^sterns  Engineering 
(e.g.,  Jens  Rasmussen,  Kim  Vicente) 

Oiathbution  subject  to  limKatiens  on  title  page 


Work  Functions:  Control  & 
monitor  AC  attitude,  heading, 
&  airspeed 

Contextual  Factors:  Keep 
eyes  on  the  sky,  especially 
takeoff  and  landing 
HCI  Solution:  Graphical  & 
alphanumeric  Information 
overlays  cockpit  view 
window 

Work-Aiding  HCI  Pattern? 


Identifying  &  Validating  Patterns 

Statistical  vs.  Content  Basis 


•  Traditional  HCI  Design  Patterns:  Statistical 
validation  based  on  large  design  sample  size 

•  Work-aiding  approach:  Reverse  engineer  the  few 
content-valid,  cognitively-based  C2  designs 

-  Inductively  reason  HCI  design  patterns  (general) 
from  small  number  of  examples  (specific) 

-  Decompose  HCI  design 

•  Indirect  aiding:  Work  Fieid  Representations, 
Traditional  HCI  design  patterns 

•  Direct  aiding:  HCI  automation  patterns 

-  Decompose  work 

•  Work  functions  supported  by  design 

•  Work  factors  &  constraints  represented  in  design 

-  Build  hierarchy  of  C2  work  functions,  associate 
with  work-aiding  HCI  design  patterns 

Distribution  subject  to  limitations  on  tltto  pago 
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AMC  TACC/XONI  Integration  Facility  -  Scott  AFB 


-  Five  HCI  development  projects  to  date 

-  C2  operator  access 

•  HECS  In-House  Prototyping  Laboratory 

-  HCI  prototyping  and  human  subject  testing 

-  Data  feeds  from  AMC 

-  Secure  room 
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Technical  Objectives 


Work  Pattern 
Model 
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Work  Field 
Representation 


Intelligent  Agent 
Automation 


Communication 
&  Design  Aids 
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Models  &  Methodologies 

-  General  theory  of  work 

-  Work  pattern  template 

-  Decomposing  work-field  representation 

-  HCI  automation  pattern  catalog 

-  Validation,  Verification  &  Accreditation 

Communication  &  Design  Aids 

-  Library  of  C2  work  patterns 

-  Library  of  HCI  Design  Patterns... 

•  Re-usable,  work-aiding,  flexible 

•  Associated  with  C2  work  patterns 

-  Software  modules  embedding  design 
patterns 

•  Plug-and-play  in  IDE 

•  Tailorable  HCI 
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Technical  Objectives 

SPAWAK  m 

Syttm*  CtnHr 
San  Diago 

•  Models  &  Methodologies 

-  General  theory  of  work 

-  Work  pattern  template 

-  Decomposing  work-field  representation 

-  HCI  automation  pattern  catalog 

-  Validation,  Verification  &  Accreditation 

•  Communication  &  Design  Aids 

-  Library  of  C2  work  patterns 

-  Library  of  HCi  Design  Patterns... 

•  Re-usable,  work-aiding,  flexible 

•  Associated  with  C2  work  patterns 

-  Software  modules  embedding  design 
patterns 

•  Plug-and-play  in  iDE 

•  Tailorable  HCI 
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Status 

Inductive  Pattern  Mining 


•  Case:  Air  Mobility  Mission  Management 


Weather  Hazard  Monitoring  MAF/CAF  Escort  Mission  Pianning  & 

(AMC/TACC)  Execution  (AMC/TACC  &  ACC/AOS) 


Muiti-Mission  *  Routes  Mission  Planning 

Hazard  Summary  •  Weather  Overiays  Status 


•  Airfield  status 

•  Exception  Reporting 

OistritMjtion  subject  to  IlmKations  on  title  page 
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Vision  for  Design  Tool 


•  HCI  Wizard  within  an  Integrated  Development  Environment 

-  Navigate  C2  work  function  taxonomy 

-  Review  potentiai,  relevant  HCI  patterns  per  work  functions 

-  Select,  assemble,  &  populate  HCI  patterns  for  specific  project 

-  Output:  Notional  HCI  Design,  Skeletal  HCI  Specification 
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Vision  for  Joint  Operations 


•  DOD  Pattern  Library 

“Flexible  standardization”  of  HCi  in  C2 
“Human  interoperabiiity”  across  armed  services 
Foundation  for  C2  training 

Enterprise  Resource 


Distribution  subject  to  IlmmUona  on  title  pafl« 
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Value  to  Stakeholders 

Sy»t»m$  C»nt»r 
Smn  Dhgo 

•  Cognitive  Systems  Engineering  (CSE) 

-  Establishes  science  of  design  through  evolutionary  C2  pattern  development 

-  Preserves  work-aiding  properties  of  HCI  throughout  product  lifecycle 

-  Incorporates  legacy  HCI  guidelines,  traditional  HCI  design  patterns 

•  Systems  Engineering 

-  CSE  delivers  software:  “plug  and  play”  HCI  designs  developed  in  an  IDE 

-  System  Engineers  can  anticipate  human  performance  parameters 
associated  with  HCi 

•  Program  Managers  ~ -jh', 

-  Meets  affordaf)///tv  through  software  reusability  ;  «  » 

-  Reduces  project  risk  associated  with  HCI 

•  C2  &  Net-Centric  Ops 

-  Assures  HCI  success  in  aiding  human  operator 

-  Promotes  human  interoperability  across  distance,  missions 

OlatrUKilion  subiaet  to  llmmtion»  on  tHU  pag« 
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Collaboration 

Past,  Present,  &  Future 


•  Past 

-  Northrop  Grumman  (Co-developed  initial  work -aiding  approach) 

-  SRA  (Four  design  patterns  for  Time  Critical  Targeting) 

•  Present  &  Future 


-  SPAWAR 


'FMmmt 


•DOD  Pattern  Library 
•Joint  desi  gn  pattern  methodology 
-  HCI  Reuse  Case  Study  (HECS) 
•Global  Strike  AOC,  Barksdale  AFB 


-  DOD  HFE  TAG 


-  Other  DOD  Agencies  sought 


DIttribuHon  subject  to  limitations  on  title  page 
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•  Situation:  Human  Computer  Interface  (HCI)  critical  factor 
of  Net-Centric  Command  and  Control  (C2) 


» Complication:  Cognitive  Systems  Engineering  (CSE)  lacks 
HCI  design  methodology  -  “Design  Gap” 

» Implication:  Expensive  custom  designs,  and  uncertain 
outcomes,  marginalizes  CSE  contributions  in  Systems 
Engineering  projects 

•  Solution:  Methodology  and  library  of  HCI  Design  Patterns 
assisting  C2  cognitive  work 

•  Benefit:  CSE  delivers  reusable  HCI  software  embedded  in 
development  environment,  meeting  affordability  goals  and 
advancing  human  interoperability  within  joint  missions 

~  Invitation  to  Participate  ~  fl^p 

OliWbutlon  aubject  to  limltatiorn  on  titl*  pag* 


Situation 

•The  concept  of  Net  Centric  Ops  offers  the  opportunity  for  sharing  information  between  distributed 
warfighters  and  systems  like  never  before. 

•C2  centers  are  a  natural  benefactor  of  NCO  since,  by  design,  they  coordinate  and  direct  operations 
that  are  distributed. 

Complication 

•However,  NCO  is  a  double-edged  sword  for  C2  centers.  While  it  offers  information  sharing  like  never 
before,  it  creates  new  task  demands  of  info  management  with  the  potential  for  warfighters  to  get  lost 
in  the  sea  of  data. 

•With  NCO  in  C2  centers,  the  HCI  becomes  the  gateway  into  the  distributed  network,  with  the  dual  job 
of  accessing  and  presenting  information  in  useful  manner,  while  filtering  out  what  is  irrelevant. 

•But  currently,  there  are  no  established  HCI  solutions  for  command  and  control. 

•There  is  also  no  standard  methodology  for  translating  the  cognitive  work  requirements  associated 
with  C2  into  work-aiding  HCI  designs  for  C2. 

Implication 

•As  a  result,  each  HCI  design  for  C2  tends  to  be  one-of-a-kind  solution.  One-of-a-kind  solutions  means 
longer  development  time  and  cost.  They  also  mean  there  can  be  no  guarantee  early  in  the  stages  of  a 
design  project  that  the  finished  product  will  assist  human  operators  in  their  work  within  C2. 

Solution 

•We  advocate  developing  a  library  of  HCI  templates  designed  specifically  to  help  with  C2  operations. 
The  HCI  templates  can  be  reused  in  different  HCI  design  projects  where  the  work  requirements  are 
similar. 

Personal  Introduction 

•My  name  is  Terry  Stanard,  and  my  background  is  cognitive  systems  engineering.  Prior  to  joining  the 
Human  Effectiveness  directorate,  I  worked  for  6  years  at  Klein  Associates  investigating  and  modeling 
cognitive  work  requirements  and  recommending  HCI  designs  in  Army,  Navy,  and  Air  Force  domains  of 
operation. 

More  Information 

Cognitive  systems  engineering  has  collectively  amassed  enough  experience  modeling  work  and 
designing  work-aiding  HCIs,  that  we  should  be  able  to  build  a  library  of  reusable  HCI  templates  for  C2. 
My  goal  for  this  presentation  is  to  acquaint  you  with  the  problem  and  our  approach,  and  attract  your 
participation  in  this  effort. 

Reusable  HCI  templates  can  provide  HCI  designers  with  proto-designs  that  are  known  to  assist  human 
operators  perform  certain  C2  work  functions.  They  can  reduce  the  HCI  development  time  and  increase 
assurance  of  a  performance  benefit  to  the  HCI. 


